Showing skin lesion information

ABSTRACT

Among other things, on a two-dimensional electronic display, a representation is shown of a scanned image of a lesion on the skin of a real human. On the two-dimensional electronic display, a recommendation is indicated of a next diagnostic or treatment step to be taken, based on a computer-implemented analysis of the scanned image.

RELATED APPLICATION

This application claims priority to U.S. provisional application Ser.No. 61/280,386, filed on Nov. 3, 2009, the contents of which areincorporated herein by reference.

BACKGROUND

This description relates to showing skin lesion information.

Skin lesion information, including scanned images of skin lesions andrelated data, can be stored on and displayed by computer to adermatologist or other user to aid in diagnosis and treatment.

SUMMARY

In general, in an aspect, on a two-dimensional electronic display, viewsof a human model that together represent all of the skin of acorresponding real human are shown simultaneously. Sex-related visiblecharacteristics of the model are presented in a manner that canrepresent a real human of either sex. Visible marking is done, on theviews of the surface of the human model, of the locations of skinlesions on the corresponding real human for which digital image scansare available.

Implementations may include one or more of the following features.

The views of the human model include views in which the arms of themodel are not raised and views in which the arms of the model areraised. The views of the human model include a view of the bottom of thefeet. The views of the human model include a view of the top of thehead. The views include top, bottom, left side, right side, front, andrear. The sex-related visible characteristics are presented as smoothsurfaces. The markings of the locations of skin lesions include icons.The markings of the locations of skin lesions include colors thatcorrespond to a status of the lesions.

In general, in an aspect, on a two-dimensional electronic display,available views of a surface of a human model are shown simultaneously,the views representing skin of a corresponding real human that may bearskin lesions for which digital image scans are available. At least someavailable views are automatically not shown, for which the correspondinghuman does not bear skin lesions for which digital image scans areavailable.

Implementations may include one or more of the following features. Theavailable views include views with arms raised and views without armsraised. The views that are not shown are views in which the arms of themodel are raised. The locations of the lesions are marked on the viewsof the human model.

In general, in an aspect, on a two-dimensional electronic display, ascanned image is shown of a lesion on the skin of a real human. Thescanned image represents only light within a limited wavelength bandthat is narrower than a full band of visible or infrared light.

Implementations may include one or more of the following features. Thescanned image comprises a thumbnail image. The scanned image comprisesone of a series of thumbnail images. Each of the thumbnail images can beinvoked by the user to cause an enlarged version of the image to beshown.

In general, in an aspect, on a two-dimensional electronic display, ascanned image is shown of a skin lesion on the skin of a real human andan indication of a result of a computer-implemented analysis of thescanned image of the skin lesion. On the shown image, visible elementsare identified that were not considered in the computer-implementedanalysis of the skin lesion.

Implementations may include one or more of the following features. Thevisible elements include hair. The visible elements include bubbles. Thevisible elements include an added boundary around the lesion. The useris enabled to control aspects of the identification, on the shown image,of the visible elements.

In general, in an aspect, on a two-dimensional electronic display, arepresentation is shown of a scanned image of a lesion on the skin of areal human, and, on the two-dimensional electronic display, arecommendation is indicated of a next diagnostic or treatment step to betaken, based on a computer-implemented analysis of the scanned image.

Implementations may include one or more of the following features. Thenext diagnostic or treatment step includes biopsy. The next diagnosticor treatment step includes observation. The recommendation is indicatedin a text box superimposed on the representation of the scanned image ofthe lesion. The recommendation is indicated by an icon. Therecommendation is indicated by a color. A user is enabled to control theappearance of the recommendation.

In general, in an aspect a user of a skin lesion scanning device isenabled to perform no more than a predetermined amount of fee-bearingscanning of skin lesions on an identified human. On a two-dimensionalelectronic display, a status is shown of actual fee-bearing scanningrelative to the predetermined amount.

Implementations may include one or more of the following features. Theamount of fee-bearing scanning includes a number of completed scans. Thenumber of completed scans is governed by information on a memory cardassociated with the identified human. The status indicates how many morecompleted scans can be performed.

In general, in an aspect, a user of a skin lesion scanning device isenabled to perform scans using the device only when the device operateswithin specified tolerances. On a two-dimensional electronic display,the user is shown how imminently the performance of the device needs tobe checked.

In general, in an aspect, on a two-dimensional electronic display, thefollowing are shown simultaneously: (a) at least a partial body view ofa surface of the human model on which a location of a skin lesion on acorresponding real human has been indicated, and (b) an enlarged view ofa lesion on a portion of the skin of a real human that corresponds tothe partial body view of the human model. Each of the views isautomatically updated in response to user interaction with the otherview, to keep the views synchronized.

Implementations may include one or more of the following features. Thepartial body view includes background portions that are not parts of thehuman model. The enlarged view of the lesion excludes backgroundportions that do not represent the desired portions of the skin of thereal human. The at least partial body view includes a view of the entirebody of the human model. Simultaneously with the partial body view andthe view of the lesion, a thumbnail is shown of the partial body view.All of the views bear indications of the location of the skin lesion.

In general, in an aspect, on a two-dimensional electronic display, atleast one view is shown of a surface of a human model and indications ofskin lesions on the skin of a real human corresponding to the shown viewof the human model. Legends are shown, for the respective skin lesions,each indicating a status of a corresponding skin lesion and a status ofa scanned image of the skin lesion.

Implementations may include one or more of the following features. Thestatus of the corresponding skin lesion includes a recommendation of anext step of diagnosis or treatment. The status of the scanned imageincludes progress in completion of an analysis of the image. The legendincludes a color. The legend includes an icon. The legend includes aprogress bar.

In general, in an aspect, on a two-dimensional electronic display, anavigable set of thumbnails is shown of body views of a human model,each thumbnail representing a single scan of a lesion on the skin of acorresponding real human. In response to a user invoking any one of thethumbnails, a larger image is automatically displayed of thecorresponding scan of the lesion separately from the thumbnail. In someimplementations, the thumbnail includes an indicator of the status ofthe lesion.

In general, in an aspect, on a two-dimensional electronic display, animage is shown of a single scan of an area on the skin of a real human,and a presence of two or more skin lesions is indicated within thesingle scan.

Implementations may include one or more of the following features. Anext diagnostic or treatment step to be applied is indicated withrespect to each of the two or more skin lesions independently. The nextdiagnostic or treatment step comprises biopsy. The next diagnostic ortreatment step comprises observation. The next diagnostic or treatmentstep is indicated by a color. The next diagnostic or treatment step isindicated by an icon. The presence is indicated on the image of thesingle scan. The presence is indicated on a marker that is not on theimage of a single scan. The marker indicates the status of all of thetwo or more skin lesions.

These and other aspects and features, and combinations of them, can beexpressed as methods, apparatus, program products, methods of doingbusiness, systems, components, means for performing functions, and inother ways.

These and other aspects and features will become apparent from thefollowing description and the claims.

In general, in an aspect, on a two-dimensional electronic display, arepresentation is shown of a scanned image of a lesion on the skin of areal human, and, on the two-dimensional electronic display, arecommendation is indicated of a next diagnostic or treatment step to betaken, based on a computer-implemented analysis of the scanned image.

DESCRIPTION

The patent or application file contains at least one drawing executed incolor. Copies of this patent or patent application publication withcolored drawing(s) will be provided by the patent office upon requestand payment of the necessary fee.

FIGS. 1 through 4 are flow diagrams.

FIGS. 5 through 58 are screen shots.

By providing novel features in a user interface of acomputer-implemented skin lesion information system, a dermatologist orother physician or other medical worker, researcher, or patient (or anyother user) can (among other things) acquire, enter, store, review,analyze, annotate, process, manage, and use for diagnosis or treatment(among other things), skin lesion information (including scans of skinlesions, data about the scans, and any other kind of information aboutskin lesions), effectively, inexpensively, accurately, comfortably,quickly, and safely.

The features discussed here can be used alone or in combination withother user interfaces in a wide variety of skin lesion systems. The skinlesion systems can include general purpose and special purposecomputers, machines, devices, equipment, and systems of any kind,including systems that have scanning devices, storage, memory, anddisplay devices, for example. The implementations can use handhelddevices, workstations, networks, and any other systems that process orstore information or communicate it locally or remotely. When a computeris used in an implementation, the computer can have typical or specialmemory, storage, displays, keyboards, mice, communications capabilities,and other features. And a wide variety of operating systems, andapplication software can be used.

In some examples, the features of the user interface can be implementedon a mobile cart of the kind described in U.S. patent application Ser.Nos. 29/341,111, 29/341,114, and 12/512,775, all three filed on Jul. 30,2009. Skin lesion information may be stored on and retrieved from memorydevices of any kind including the memory cards or usage cards describedin U.S. patent application Ser. No. 12/512,895, filed Jul. 30, 2009.Usages of the systems associated with usage cards can be monitored andcontrolled as described, for example, in U.S. patent application Ser.No. 11/761,816, filed Jun. 12, 2007. Additional information concerninguser interfaces for skin lesion systems is found in U.S. patentapplication Ser. No. 11/681,345, filed Mar. 2, 2007. Additionalinformation about identifying a location of a lesion on a human body isfound in U.S. patent application Ser. No. 12/204,247, filed Sep. 4,2008. All of the applications and patents identified here and elsewherein this application are incorporated here by reference.

In some implementations, the lesion scanner used with the user interfacecan be a MelaFind probe developed by Electro-Optical Sciences, Inc., amulti-spectral scanner. Some information about the implementation of theMelaFind system can be found in United States patents and patentapplications assigned to Electro-Optical Sciences, Inc., andincorporated here by reference, including U.S. Pat. Nos. 6,081,612;6,208,749; and 6,626,558.

FIGS. 1 through 4 respectively relate to flows experienced by users of auser interface in the contexts of administration, use of the system, useof a “phantom target” for testing functionality of a skin imaging device(“probe”), and practice scanning of a skin lesion. Each of the fourfigures presents the flow by showing blocks 102 corresponding to userinterface screens. In each of the blocks, most of the detail of the userinterface is not shown on FIGS. 1 through 4.

In general, but with some exceptions, the flow in each figure proceedsfrom left to right. Flow lines 104 in the figures connect user controls106, such as buttons, in some of the screens, to other screens thatappear when the user invokes the controls. In some cases, a flow lineindicates a connection by pointing to a box 108 which contains areference to the screen to which control is shifted. In each of the fourfigures, each of the thumbnails bears an identifying number tofacilitate references to one another.

FIGS. 5 through 57 show much larger and fully detailed versions of thesame screens that appear as blocks in FIGS. 1 through 4. Each block ineach of the FIGS. 1 through 4 has a number 110 below it that identifiesthe later figure that contains the corresponding larger image of thatscreen. In addition, each of the later figures includes enlargedportions of the flow lines 104 and the boxes 108.

Turning to the flow to which FIG. 1 pertains, and as shown in FIG. 5, anintroductory screen provides text entry boxes 502, 504 for theadministrative user to enter the User Name “Admin” and theadministration Password. Buttons 506, 508 can be invoked to Log In orLog Out. Successful login leads to the screen of FIG. 6 in which ananimation shows to the user that a usage memory card 602 should beinserted in a card reader 604, in the orientation illustrated in theanimation. Home and Back buttons 606, 608 return the user to the screenof FIG. 5. Invoking an Admin button 610 leads the user to the screen ofFIG. 7.

In FIG. 7, each of four tabs 702 can be invoked to direct the user tofour other screens that are used for administration. The initial UserAccount tab screen, shown in FIG. 7, lists User Names 704, Names 706,and Account Type 708. Scroll buttons 710, 712 enable the user tonavigate the list if there are more entries than can be shown on asingle screen. Buttons 714 can be invoked to enable the user to Add,Remove, or Change a user account. In general in all of the screensdiscussed with respect to FIG. 1, a Log Out button 716 allows the userto log out, which returns the user to FIG. 5, and an Exit Admin button718 allows the user to return to the initial administration screen ofFIG. 6.

Invoking the Add button 714 leads to FIG. 13, which provides text entryboxes that enable entry of an Account Type 1302, a Login User Name 1304,a Name 1306, a Password 1308, and a verification of the Password 1310.Cancel and OK buttons 1311, 1312 (here and in other figures discussedlater) enable the user to commit the entries in the text boxes, or tocancel those entries.

Invoking the OK button leads to the screen of FIG. 19 on which the newaccount has been added. In FIG. 19, and whenever the User Accounts listis displayed, an administrative user can invoke any of the accounts 1902by clicking on it, which leads to the screen of FIG. 20 on which theselected account is highlighted, and the administrative user can add,remove, or change the account by invoking the buttons 714. The Addbutton returns the user to the screen of FIG. 13.

The Remove button 714 returns the user to the screen of FIG. 14, whichincludes a warning message 1402 and Cancel and Remove buttons 1404,1406, which here (and in other screens) enable the user to cancel theremoval request or confirm the removal. Canceling the removal requestleads the user to the screen of FIG. 8; confirming the removal leads tothe screen of FIG. 15.

FIG. 8 shows the account list as it was originally. (Note that in FIG.1, the flow line that connects FIG. 14 to FIG. 8 is with reference to acanceled account addition that occurred through the flow from FIG. 7 toFIG. 8 to FIG. 13 to FIG. 14, and not, in this example, the flow thatpassed through FIGS. 19 and 20.) FIG. 8 is like FIG. 7 except that theentry that had been considered for removal remains highlighted. The usercan again invoke any of the Add, Change, and Remove buttons 714.Invoking the Change button on FIG. 8 leads to the screen of FIG. 9,discussed below.

In FIG. 15, which is reached from FIG. 14 by confirming the removal, theaccount list is shown with the account removed.

When an account is to be changed, either from FIG. 8 or from FIG. 20, ascreen is shown (FIGS. 9 and 21, respectively) that enables the changeinformation to be entered. (FIGS. 9 and 21 differ because they arereached when the account list is in different states.). In the exampleof FIG. 9, text boxes are provided for changing any of the items ofinformation that were previously entered in the screen shown in FIG. 13.Invoking the OK button on FIG. 9 returns the user to the account listwith the account information changed (FIG. 7). A similar explanationpertains to FIG. 21 with respect to FIG. 19.

FIGS. 10, 11, 16, and 22 provide a similar capability for adding,removing, and changing entries in a list of physician users, all withinthe Physician List tab.

Invoking the Settings tab leads to the screen of FIG. 12 in which theuser can use radio buttons 1202 to choose or re-choose when to showresults and whether to show a Management Decision. The Date & Time tab,shown in the screen of FIG. 18, shows and allows for resetting of thedate and time.

Turning now to the main user flow shown in FIG. 2, when there has beenno activity for a period of time, and when the system is initialized,the screen of FIG. 23 is presented and the user is invited to “Touchanywhere” to begin. Touching the screen leads to the screen of FIG. 5.If the User Name or Password is incorrect, when the Log In button isinvoked on the screen of FIG. 5, the screen of FIG. 24 is displayed, andthe user can try again. Upon successful login, the screen of FIG. 6 isdisplayed.

If the user inserts a card that is not readable or not authorized foruse, the screen of FIG. 25 is displayed. The user is warned of theerror, and by invoking the OK button can try again. Once a validreadable card has been inserted properly, the screen of FIG. 26 ispresented to enable the user to enter an identifier of a patient in aPatient ID text entry box 2602 and to identify a physician using aPhysician drop down box 2604, which leads to the screen of FIG. 27,where a physician is chosen, and then to the screen of FIG. 28 in whichthe selected physician is displayed. If the inserted card is one thathad been used previously, the patient ID is read from the card anddisplayed in FIG. 26. If the inserted card is a new one, the user canenter a patient ID which is then written onto the card. FIG. 2 does notinclude explicit flow lines that connect a screen to the next screenthat appears when the user invokes the Next button. Generally, the nextscreen is the one to the right of the current screen or in the columnnext to the right, and the flow line or lines are implicit.

FIG. 26, and other figures associated with the flow of FIG. 2 include aBack button 2608 which returns the user to the previous screen, and aNext button 2610 which causes the next screen in the sequence to bedisplayed.

FIG. 29 shows the next screen after FIG. 28. The screens of FIGS. 29through 44 provide a simple-to-use and very powerful navigational andinformational interface for the user to understand, observe, use, andprovide information about the lesions associated with the patient and toacquire scans of new lesions. On each of these screens a banner 2902 atthe top identifies the patient ID, the user's name, the number ofremaining images of skin lesion scans that can be added to the card, andthe current date and time. In general, all of the screens of the userinterface include the banner 2902 and the information shown on thebanner varies depending on the state of the interface.

There are three types of screens represented in the group of FIGS. 29through 44. The screens of FIGS. 29 through 31 are scan preparationscreens that enable the user to identify the locations of (and enternotes concerning) lesions that are to be scanned on the patient. Thelegend 3001 at the bottom of the screens provides instructions andguidance to the user about the function to be performed on the screen(and this also is true of other screens discussed above and below). Forexample, on the screens of FIGS. 29 through 31, the legend 3001 providesthe instruction “Identify Lesion Location . . . ” to alert that user touse these screens to point out the location of a lesion that is going tobe scanned.

In the screen of FIG. 29, for example, there are two viewing tabs 2901and 2904. Tab 2901 bears thumbnail images of a body of a model viewedfrom six different perspectives: top (looking straight down on thehead), bottom (looking straight up at the bottoms of the feet), leftside, right side, front, and back. The main part 2906 of the tab 2901shows larger versions of the six views. The tab 2904 similarly has fourthumbnail and larger views, left, right, front, and back, of the modelwith arms raised, so that parts of the body not visible in tab 2901 arevisible in tab 2904. When a tab has been invoked the thumbnail views arevisible, and when the tab has not been invoked the thumbnail views aregrayed. The screen of FIG. 30 is shown when tab 2904 is invoked.

The human model views of FIG. 29 and other figures discussed below arearranged to represent a real human of either sex. In particular, certainsex-related features of the body, such as the genitals, are not shownexplicitly, but instead are replaced by a smooth surface that can beinterpreted as belonging to either sex. Hair is not shown on the model,which enables lesions to be identified and shown on parts of a realhuman that are normally obscured by hair, such as a lesion in the pubicregion of the body, or on a bearded face or on top of the head. Inaddition, the absence of hair contributes to the impression that themodel could represent a real human of either sex. The human model isconstructed digitally and is not a photograph of a real human. Thus, thesurfaces, symmetry, body build, proportions, shape, and size of thehuman model are stylized. As shown in FIG. 58 (and other figures, inwhich this feature may not be apparent because the lines are fine), agrid 5802 of generally vertical and horizontal lines is shown on thesurface of the human model. These lines can be used as a basis foridentifying the precise locations of lesions on a real human anddisplaying those locations accurately on the human model, among otherthings.

On the left side of the screen of FIG. 31 (and other figures) a lesionnavigation pane 3102 is displayed that includes thumbnail images 3103identifying locations of lesions on this patient, and triangular up anddown scroll buttons 3104, 3106, that enable a user to scroll up and downto find a lesion of interest if not all thumbnails will fit in the pane.When a new lesion is to be scanned on the patient by the user of theinterface, a New Lesion button 3108 is displayed. Invoking the NewLesion button enables the user to indicate the location on the body ofthe patient of the lesion that has been scanned, by using the model thatis displayed in model tabs 2901, 2904.

In FIG. 31, if the user touches a location 3108 on one of the views ofthe model, the lesion location pane 3110 shows an enlarged, close-upview of the portion of the model that was touched. Next, the user cantouch a location 3112 in pane 3110 to indicate the location of the scan.A marker 3114 is then displayed at the location of the lesion. Inaddition a corresponding thumbnail 3115 is placed in the lesionnavigation pane. The user can enter text Notes 3116 in a text pane 3118that may identify, describe, or otherwise relate to the lesion. Thecontent of the notes pane is linked to and synchronized with the imagein the lesion pane, the lesion navigation pane, and the viewing tabs,for display purposes.

A second set of the screens, in FIGS. 32 through 40, include the lesionnavigation pane on the left, and have the lesion pane and the notes panerelocated to the left. These screens enable a user to prepare for andthen acquire a new scan of a skin lesion of the patient, for example, atthe location identified in FIG. 31.

In the example as shown in FIGS. 31 and 32, the user has identified alocation at which a new lesion will be scanned. The location isrepresented on the lesion thumbnail 3115 and on the enlarged view of themodel in the lesion location pane using a cross hair marker in red.Typical notes concerning the lesion are shown in the notes pane, and thenotes can be edited. The user may invoke either of two Imaging Optionbuttons 3202 and 3204, to indicate that the user wishes to acquire ascan of the lesion at that location either using a dermascope(Dermascopic Imaging) or a hand-held MelaFind probe (MelaFind Imaging).Although in this discussion we refer to the possibility of dermascopicimaging and to the display of the results of such imaging, in someimplementations of the user interface, dermascopic imaging might not beenabled, in which case dermascopic images would not be displayed. Insome other implementations, images acquired with the MelaFind probecould be displayed in a “Dermascopic Imaging” mode.

Once the user has identified the location of the lesion, the screen ofFIG. 32 advises the user to choose an imaging option. After one or theother of the buttons 3202, 3204 is invoked, the screen of FIG. 33 isdisplayed, which invites the user, in the message in the legend 3001 atthe bottom of the screen, to use the hand-held scanner to scan thelesion. When the user begins the scan, the screen of FIG. 34 isdisplayed with the message “Imaging Lesion.” FIG. 34 shows a portion3208 of an image of a lesion in a Multispectral Analysis pane 3206 onthe right side of the screen. During scanning a progress bar 3430 underthe thumbnail for the lesion being scanned shows progress towardcompletion of the scanning process.

On the right side of the multispectral analysis pane 3206 a column 3210of thumbnail positions 3211 represents a succession of spectral bandsfor which spectral-band images are taken, for example, when the MelaFindprobe is used to scan a lesion. Each of the thumbnail positionsrepresents the spectral-band image for one of the spectral bands. Thepresence of a thumbnail 3212 in one of the positions in the columnindicates that the corresponding spectral-band image has been acquiredfor that band. The summary button 3214 on the screen of FIG. 34 (and onother screens) enables the user to move to a screen, such as the oneshown in FIG. 41, that provides a summary of scans stored on the memorycard for this patient.

The scan of FIG. 35 shows a state in which scanning has been completedand the scanned images are being processed. The progress towardcompleting the image processing is indicated in a progress bar 3502 aswell as in the lesion thumbnail and a legend 3504 above the barindicates the step that is being performed, in this case “DetectingHair; Calculating Features . . . .” In this instance, the hair beingdetected is highlighted 3506 in the multispectral analysis pane. Becausethe scanning has been completed, all of the thumbnail positions in thecolumn 3210 contain thumbnails, and the bottom position in the columnshows a thumbnail of the “full-spectrum” (reconstructed color) image.

When the image processing has been completed, the screen of FIG. 36 isdisplayed, including the legend 3001 “Imaging Complete . . . .”Thumbnails of other images that have been scanned now also appear inpane 3102.

In addition, results of the most recently completed scan are shown intext boxes such as 3604, 3606 in the multi-spectral analysis pane. Inthis instance, the scan contained two different lesions, which wereanalyzed separately, and are both included in the image of the scan. Theresult for the left lesion is “MelaFind Negative” and the lesion area isreported in square millimeters. The result for the right lesion is“MelaFind Positive” indicating a recommendation that a biopsy beperformed. These results (positive or negative, indicating the need tobiopsy or not) are of the kind described or referred to in U.S. patentapplication Ser. No. 11/761,816, filed Jun. 12, 2007; Ser. No.11/681,345, filed Mar. 2, 2007; Ser. No. 11/956,918, filed Dec. 4, 2007;and Ser. No. 12/512,895, filed Jul. 30, 2009, all of which areincorporated here by reference. In each of the Result boxes, one of twoicons 3605, 3607 is highlighted to indicate either that the lesionshould be biopsied (microscope icon) or that it should be observed (eyeicon). The Result boxes are displayed directly on the scanned image inthis example, but could also be displayed in a wide variety of otherways.

The completion of the image processing for a scan, as represented in thescreen of FIG. 36, and the storage of the images and related data on thememory card completes the scan and represents a usage (or depletion) ofone of the available scans on the memory card. The number of ImagesRemaining on the card, shown in the entry 3602, is reduced by 1, in thiscase to “9 images”. This message alerts the user to how many additionalscans can be stored on the memory card for this patient, before anothercard needs to be used.

Also, with the completion of image processing for the current scan, thegeneral state of the screen is changed so that it is no longer in ascanning mode, as discussed above, but is now in a lesion navigationmode. In the lesion navigation mode, the screen elements are arranged toenable a user to navigate easily from one of the scanned lesions toanother and therefore to view the images of different lesions, themulti-spectral images for each lesion, and the results of the analysisof each lesion, among other things.

In the lesion navigation mode, the lesion navigation pane 3102 isupdated to show thumbnails of all of the lesions that have beensuccessfully scanned, processed, and stored on the memory card. Thescroll buttons 3608, 3610 become brighter and are active to permit easynavigation, and the user can invoke any of the lesion thumbnails in thepane, which then is highlighted to indicate that it has been invoked.(In general, when a user control is displayed more brightly on any ofthe screens, that control is active and can be invoked, and when it isdisplayed less brightly (“greyed”), it is inactive and cannot beinvoked.)

In the lesion navigation mode, as shown in FIG. 36, and enlarged in FIG.58, additional user controls are displayed, including Previous Lesionand Next Lesion buttons 3612, 3614, which enable the user to quicklymove back and forth in the sequence of stored lesions. A Hide Resultbutton 3616 can be toggled to show or hide the Result text boxes 3604,3606. Artifacts of the images and viewing aids can be shown or hidden bytoggling the Show/Hide Border button 3624 (which toggles the border 3623shown around each lesion corresponding to the border that was used todefine the lesion for image processing purposes); the Show/Hide Hairbutton 3622, the Show/Hide Bubbles button 3620, and the Show/Hide Allbutton 3618. A Show/Hide Result button 3616 enables toggling betweenshowing the Result text boxes or hiding them.

The screen of FIG. 37 is like the screen of FIG. 36 except for theaddition by the user of a “Biopsy” note in the Notes pane. The screen ofFIG. 38 is similar, but the results are hidden.

In some cases, the scan attempted by the user fails because the imageanalysis cannot be done effectively with an appropriate degree ofconfidence. The screen of FIG. 39 is then displayed to the user,including an error message 3902, which indicates the existence of theerror and provides an explanation, in this case “Too many bubbles. Userolling technique.” The screen also includes a “Save as DermascopicImage” button 3904 (which enables the user to save the image but withoutthe results of image analysis) and a ReImage button 3906 (which allowsthe user to restart the imaging process for the identified lesion).

As illustrated by the screen of FIG. 40, the user can use the thumbnailsin the column on the right side of the Multi-Spectral Analysis pane toselect and view the full-spectrum image (as is the case in FIG. 40) orany of the spectral-band images. This enables the user to observe,understand, and develop an instinctual understanding for therelationship between the result being displayed and the characteristicsof the various spectral-band images associated with that result.

The screens of FIGS. 41 through 44 are the summary screens that enablethe user to view, using the model and the lesion navigation pane, all ofthe scans and results for all of the imaged lesions of the patient. Inother words, these screens present an easily navigable overview of thescanned skin lesion situation for this patient. In all of these screens,the banner 2902 includes an alert 4102 that informs the user how muchtime is left before a scan must be done of a phantom target so as toenable a “Self-Test” of the probe functionality.

In the example screens of FIGS. 41 through 44, a summary bar 4104illustrates (using a color key and different symbol shapes) the numberof lesions of each of four types: MelaFind Positive, MelaFind Negative,Dermascopic, and images that still are in the state of Processing. Inother implementations, not illustrated here, the “Dermascopic” typecould either be absent or replaced by another type. A Show/Hide Resultbutton 4302 (see FIG. 43) is used to toggle the screens between onestate in which MelaFind results are shown (FIG. 41 for example), and asecond state in which they are not (FIG. 43, for example).

The colors and symbol shapes in the summary bar correspond to symbolshapes and colors on lesion status bars 4110. There is a status barshown for each lesion. In this case, there are twelve bars correspondingto twelve lesions that were scanned. In this example, a green eye isused to indicate that the next step is observation and a red microscopeis used to indicate that the next step is biopsy. Blue is used toindicate that computer processing is not yet complete. In this example,purple identifies a dermascopic image. Progress indications are shownalso in the lesion thumbnails. A wide variety of other colors and iconscould be used.

In the Show-Results state, each lesion status bar has a color thatcorresponds to the status of the lesion (in the example shown: positive,negative, dermascope, or in process). The bars for lesions for whichthere are MelaFind results also show icons at the left end. For imagesthat are in process, the bar shows the state of completion in the formof a progressive completion stripe. In cases in which a single scancontained more than one lesion, the lesion status bar is split to showthe results for each of the (up to four) lesions in the scan. Eachlesion bar is connected by a lead line to the location of the lesion onthe model. On the model, the marker for each lesion takes the form ofthe icon and color corresponding to the icon and color of the lesionstatus bar. A wide variety of other configurations of bars or otherindicators could be used.

The screen of FIG. 42 shows that the views of the model that are shownto the user can be increased or reduced in size, depending on which onesare required to display the locations of the lesions that have beenscanned.

In the Hide-Results state, illustrated by the screen of FIG. 43, thelesion status bars show only the state of progress (by a progress bar orthe word “completed”) of scanning and image processing for images thatyield MelaFind results, or simply the word Dermascope, for example.

In some cases, a lesion status bar has an exclamation icon, whichindicates that the instruction manual should be consulted for furtherinformation.

The lesion thumbnails in the lesion navigation pane all show barsindicating the progress of scanning and image processing.

As shown in the screen of FIG. 44 (and in either the Show-Results orHide-Results state), an End Session button 4402 is displayed. The EndSession button becomes active only when all processing of all lesionshas been completed. Invoking the End Session button, when it is active,leads to the log-in screen of FIG. 5.

The screens of FIGS. 41 through 44 bear a legend 4404 “Touch Tab to ViewDetails . . . .” As an example, if one touches the bar beneath theleft-most model image shown in FIG. 41, the detailed display shown inFIG. 35 results.

Every four hours, for example, the screen of FIG. 45 is displayed as apop-up to alert the user how much time remains to “self-test” the probeusing the phantom target before the MelaFind Result feature will bedisabled. Invoking a Help button 4502 leads to the screen of FIG. 46,which provides instructions for performing the Phantom Imagingself-test. Invoking the Proceed button 4504 extinguishes the pop-upalert for four more hours. Invoking the Phantom button 4506 leads to thePhantom Imaging self-test procedure, the flow of which is shown in FIG.3.

The screens of FIGS. 47 through 51 provide instructions 4701 to the userto lead the user through successive steps to prepare and scan a phantomtarget. The Phantom Imaging process can be reached from the appropriatebutton on the screen of either FIG. 6 or FIG. 45 or FIG. 46.

A Help button 4702 always leads to helpful information about that step.A Back button 4704 always returns the user to the prior step. A PhantomImaging button 4706 arms the system for phantom imaging from the screenof FIG. 47 and leads to the screen of FIG. 48. Pulling the trigger onthe hand-held probe then starts the imaging, the progress of which isshown in the screen of FIG. 49, and in its finished state in the screenof FIG. 50, if successful, or of FIG. 51 if not successful. The ExitPhantom button 5002 enables the user to exit the Phantom Imagingprocedure.

Because the actual use of the memory card to store images of skinlesions on patients has an associated cost, the system provides aPractice mode for scanning, the process of which is tracked in FIG. 4.The sequence is illustrated in the screens of FIGS. 55, 56, 57, 52, andeither 53 or 54. As with the Phantom Imaging procedure, the user isprovided instructions on successive steps and proceeds from step to stepor back, using navigation buttons and the lesion imaging probe, untilthe scan is either successful (the screen of FIG. 53) or rejected (thescan of FIG. 54), and the user then exits the procedure.

Other implementations are also within the scope of the following claims.

For example, a wide variety of other types, arrangements, orientations,appearances, and names of the user controls, thumbnails, views, andarrangements of the user interface could be substituted for the examplesdescribed above. The sequence of actions and responses of the userinterface could also be altered. The coordination and synchronization ofdifferent views could be arranged differently. The human models could bemade more or less realistic. In some examples, actual photographs of thereal human could be substituted for the model photographs. Differentsets of human models could be available in selectable by the user torepresent real humans of different sizes, shapes, skin coloring, racialfeatures, ages, and other characteristics so that they more directlyrepresent a real human who is the subject of the skin lesion scanning.The kinds of results displayed for each of the lesions could be otherthan “positive” and “negative” and could be expressed in displayed inother ways. Other navigational devices could be provided to enable theuser to move among scans in other ways.

1. A computer-implemented method comprising showing simultaneously, on atwo-dimensional electronic display, views of a human model that togetherrepresent all of the skin of a corresponding real human, presentingsex-related visible characteristics of the model in a manner that canrepresent a real human of either sex, and visibly marking on the viewsof the surface of the human model the locations of skin lesions on thecorresponding real human for which digital image scans are available. 2.The method of claim 1 in which the views of the human model compriseviews in which the arms of the model are not raised and views in whichthe arms of the model are raised.
 3. The method of claim 1 in which theviews of the human model include a view of the bottom of the feet. 4.The method of claim 1 in which the views of the human model include aview of the top of the head.
 5. The method of claim 1 in which the viewsinclude top, bottom, left side, right side, front, and rear.
 6. Themethod of claim 1 in which the sex-related visible characteristics arepresented as smooth surfaces.
 7. The method of claim 1 in which themarkings of the locations of skin lesions comprise icons.
 8. The methodof claim 1 in which the markings of the locations of skin lesionscomprise colors that correspond to a status of the lesions.
 9. Acomputer-implemented method comprising showing simultaneously, on atwo-dimensional electronic display, available views of a surface of ahuman model, the views representing skin of a corresponding real humanthat may bear skin lesions for which digital image scans are available,and automatically not showing at least some available views for whichthe corresponding human does not bear skin lesions for which digitalimage scans are available.
 10. The method of claim 9 in which theavailable views include views with arms raised and views without armsraised.
 11. The method of claim 9 in which the views that are not shownare views in which the arms of the model are raised.
 12. The method ofclaim 9 also including marking the locations of the lesions on the viewsof the human model.
 13. A computer-implemented method comprisingshowing, on a two-dimensional electronic display, a scanned image of alesion on the skin of a real human, the scanned image representing onlylight within a limited wavelength band that is narrower than a full bandof visible or infrared light.
 14. The method of claim 13 in which thescanned image comprises a thumbnail image.
 15. The method of claim 13 inwhich the scanned image comprises one of a series of thumbnail images.16. The method of claim 15 in which each of the thumbnail images can beinvoked by the user to cause an enlarged version of the image to beshown.
 17. A computer-implemented method comprising showing, on atwo-dimensional electronic display, a scanned image of a skin lesion onthe skin of a real human and an indication of a result of acomputer-implemented analysis of the scanned image of the skin lesion,and visibly identifying on the shown image, visible elements that werenot considered in the computer-implemented analysis of the skin lesion.18. The method of claim 17 in which the visible elements include hair.19. The method of claim 17 in which the visible elements includebubbles.
 20. The method of claim 17 in which the visible elementsinclude an added boundary around the lesion.
 21. The method of claim 17also including enabling the user to control aspects of theidentification, on the shown image, of the visible elements.
 22. Acomputer-implemented method comprising showing, on a two-dimensionalelectronic display, a representation of a scanned image of a lesion onthe skin of a real human, and indicating, on the two-dimensionalelectronic display, a recommendation of a next diagnostic or treatmentstep to be taken, based on a computer-implemented analysis of thescanned image.
 23. The method of claim 22 in which the next diagnosticor treatment step comprises biopsy.
 24. The method of claim 22 in whichthe next diagnostic or treatment step comprises observation.
 25. Themethod of claim 22 in which the recommendation is indicated in a textbox superimposed on the representation of the scanned image of thelesion.
 26. The method of claim 22 in which the recommendation isindicated by an icon.
 27. The method of claim 22 in which therecommendation is indicated by a color.
 28. The method of claim 22 alsocomprising enabling a user to control the appearance of therecommendation.
 29. A computer-implemented method comprising enabling auser of a skin lesion scanning device to perform no more than apredetermined amount of fee-bearing scanning of skin lesions on anidentified human, and showing, on a two-dimensional electronic display,a status of actual fee-bearing scanning relative to the predeterminedamount.
 30. The method of claim 29 in which the amount of fee-bearingscanning comprises a number of completed scans.
 31. The method of claim29 in which the number of completed scans is governed by information ona memory card associated with the identified human.
 32. The method ofclaim 29 in which the status indication comprises how many morecompleted scans can be performed.
 33. A computer-implemented methodcomprising enabling a user of a skin lesion scanning device to performscans using the device only when the device operates within specifiedtolerances, and showing, on a two-dimensional electronic display, howimminently a performance of the device needs to be checked.
 34. Acomputer-implemented method comprising showing simultaneously, on atwo-dimensional electronic display, (a) at least a partial body view ofa surface of the human model on which a location of a skin lesion on acorresponding real human has been indicated, and (b) an enlarged view ofa lesion on a portion of the skin of a real human that corresponds tothe partial body view of the human model, and automatically updatingeach of the views in response to user interaction with the other view,to keep the views synchronized.
 35. The method of claim 34 in which thepartial body view includes background portions that are not parts of thehuman model.
 36. The method of claim 34 in which the enlarged view ofthe lesion excludes background portions that do not represent thedesired portions of the skin of the real human.
 37. The method of claim34 in which the at least partial body view comprises a view of theentire body of the human model.
 38. The method of claim 34 alsoincluding showing, simultaneously with the partial body view and theview of the lesion, a thumbnail of the partial body view.
 39. The methodof claim 34 in which all of the views bear indications of the locationof the skin lesion.
 40. A computer-implemented method comprisingshowing, on a two-dimensional electronic display, at least one view of asurface of a human model and indications of skin lesions on the skin ofa real human corresponding to the shown view of the human model, andshowing legends, for the respective skin lesions, each indicating astatus of a corresponding skin lesion and a status of a scanned image ofthe skin lesion.
 41. The method of claim 40 in which the status of thecorresponding skin lesion includes a recommendation of a next step ofdiagnosis or treatment.
 42. The method of claim 40 in which the statusof the scanned image comprises progress in completion of an analysis ofthe image.
 43. The method of claim 40 in which the legend comprises acolor.
 44. The method of claim 40 in which the legend comprises an icon.45. The method of claim 40 in which the legend comprises a progress bar.46. A computer-implemented method comprising showing, on atwo-dimensional electronic display, a navigable set of thumbnails ofbody views of a human model, each thumbnail representing a single scanof a lesion on the skin of a corresponding real human, and in responseto a user invoking any one of the thumbnails, automatically displaying alarger image of the corresponding scan of the lesion separately from thethumbnail.
 47. The method of claim 46 in which the thumbnail includes anindicator of the status of the lesion.
 48. A method comprising showing,on a two-dimensional electronic display, an image of a single scan of anarea on the skin of a real human, and indicating a presence of two ormore skin lesions within the single scan.
 49. The method of claim 48also comprising indicating a next diagnostic or treatment step to beapplied with respect to each of the two or more skin lesionsindependently.
 50. The method of claim 49 in which the next diagnosticor treatment step comprises biopsy.
 51. The method of claim 49 in whichthe next diagnostic or treatment step comprises observation.
 52. Themethod of claim 49 in which the next diagnostic or treatment step isindicated by a color.
 53. The method of claim 49 in which the nextdiagnostic or treatment step is indicated by an icon.
 54. The method ofclaim 48 in which the presence is indicated on the image of the singlescan.
 55. The method of claim 48 in which the presence is indicated on amarker that is not on the image of a single scan.
 56. The method ofclaim 55 in which the marker indicates the status of all of the two ormore skin lesions.